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© Method and apparatus for graphic processing 



© In order to reduce the amount of computation processing and simplify processing, a graphic processor 
apparatus includes a graphic signal generator circuit (1) for generating video images such as graphics and 
characters, and a filter processor circuit (2) for conducting filter processing on video images outputted from said 
graphic signal generator circuit (1). Anti-alias processing for reducing jaggy phenomena and flicker removing 
processing are simultaneously conducted in the filter processor circuit. 
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BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 

The present invention relates to a graphic processing method and a graphic processor apparatus for 
generating v.deo ,mages such as graphics and characters with reduced jaggy phenomana and flicker. 

DESCRIPTION OF THE RELATED ART 

In the field of computer graphics (CG), a technique called anti-alias is used when video images are 
displayed on a display device functioning as the output media of computer graphics. This aims at making 
delayed video images more beautiful. This technique is processing for making jaggy phenomena visually 
inconspicuous. The jaggy phenomena mean a boundary (edge) has jagged steps as shown in FIG 1 

As conventional anti-alias processing, supersampling processing is conducted. The supersamplinq 
processing includes the steps of resolving each pixel into MxN subpixels having M pixels in the horizontal 
director) and N p.xels in the vertical direction (where M and N are natural numbers), performing pixel value 
calculations with high resolution, then conducting filter processing of deriving an average or a weighted 
average of MxN subpixels, and adopting the average or weighted average as the pixel value of each pixel 

Furthermore, in the case where video images such as graphics and characters generated by a graphic 
processor apparatus are watched on an interlace television monitor of NTSC or the like, the edge portion 
turns on and off once every 1/30 second and thereby visual flicker impairment occurs. This flicker 
,mpa,rment is perceived as degradation of picture quality. In graphic processor apparatuses, therefore, 
bandwidth .limitation of the spatial frequency in the vertical direction is performed in order to remove flicker 
=K V," 's a bas.c conjuration diagram of a graphic processor apparatus capable of performing the 
above described anti-alias processing and flicker removal. Numeral 10 denotes a graphic signal generator 
circuit, which generates video images such as graphics and characters having a resolution of subpixel The 
graphic signal generator circuit 10 is often formed around a CPU. Numeral 11 denotes a weighted 
averaging processor circuit, which conducts weighted averaging processing of a plurality of subpixels with 
respect to video images generated by the graphic signal generator circuit 10. Numeral 12 denotes a 
subsampling processor circuit, which conducts subsampling processing on video images having the 
subpixel resolution outputted by the weighted averaging processor circuit 11. Numeral 13 denotes a flicker 
removing processor circuit, which conducts flicker removal on video images outputted by the subsampling 
processor circuit 12. Numeral 14 denotes an output end, which outputs video images subjected to flicker 
r ©mo V3i . 

Operation of the conventional apparatus will now be described. 

In the case where the number of pixels representing the resolution of the diaplay device is XxY with X 
pixels in the horizontal direction and Y pixels in the vertical direction, video images such as graphics and 
characters hav.ng a resolution of MxXxNxY are generated by the graphic signal generator circuit 10 In the 
weighted averag.ng processor circuit 11, weighted averaging processing of MxN subpixels is conducted on 
m J M°v mageS 9 the reso,ution of MxXxNxY, and resultant video imges having the resolution of 
MxXxNxY are outputted therefrom. In the subsampling processor circuit 12, subsampling processing is 
conducted on video images having the resolution of subpixel subjected to weighted averaging processing 
That ,s to say, subp.xels in the horizontal direction are thinned out so as to leave one subpixel out of M 
subpixels and subpixels in the vertical direction are thinned out so as to leave one subpixel out of N 
subpixels in order to restore original video images having the resolution of XxY pixels. At this time video 
.mages having the original resolution of XxY and already subjected to anti-alias processing are obtained In 
the , meter removing processor circuit 13, spatial frequency components in the vertical direction are 
subjected to bandw.dth limitation carried out by low-pass filter processing in order to remove flicker from 
subsampled video images having the resolution of the display device. 

Since high resolution processing of resolving one pixel into MxN subpixels is conducted however the 
above described conventional graphic processor apparatus has problems of increased amounts of computa- 
tion, processing cost, and processing time. Furthermore, since anti-alias processing and flicker removing 
processing are conducted, the conventional graphic processor apparatus has a problem of complicated 

Since spatial frequency components in the vertical direction are subjected to bandwidth limitation in the 
flicker removrng processor circuit, the conventional graphic processor apparatus has also a problem that 
even patterns other than edges blur and the resolution of video images is degraded 



2 



0686941A2_I_> 



4 



EP 0 686 941 A2 



SUMMARY OF THE INVENTION 

The present invention solves such problems of the conventional apparatus. 

A first object of the present invention is to provide an excellent graphic processing method and graphic 
5 processor apparatus reduced in amount of computation processing and simplified in processing in order to 
solve the above described conventional problems. 

A second object of the present invention is to provide an excellent graphic processing method and 
graphic processor apparatus reduced in amount of computation processing and simplified in processing, 
capable of preventing patterns other than edges from blurring and capable of outputting video images with 
io substantial resolution in order to solve the above described conventional problems. 

In accordance with a first aspect of the present invention, anti-alias processing for reducing jaggy 
phenomena and flicker removing processing are simultaneously conducted in filter processing. This aims at 
achieving the first object in graphic processing for generating video images such as graphics and 
characters. 

15 In accordance with a second aspect of the present invention, anti-alias processing for reducing jaggy 

phenomena and flicker removing processing are simultaneously conducted in filter processing and the filter 
processing is conducted only on edge portions judged by edge detection processing to be edges. This 
aims at achieving the second object in graphic processing for generating video images such as graphics 
and characters. 

20 In accordance with a third aspect of the present invention, anti-alias processing for reducing jaggy 

phenomena and flicker removing processing are simultaneously conducted in filter processing and the filter 
processing is conducted with filter characteristics set according to edge information derived by edge 
detection processing. This aims at achieving the second object in graphic processing for generating video 
images such as graphics and characters. 

25 According to the first aspect of the present invention, anti-alias processing for reducing jaggy 
phenomena and flicker removing processing are simultaneously conducted in the same filter processing. 
Thereby, it becomes possible to reduce the amount of computation processing and simplify the processing. 

According to the second aspect of the present invention, anti-alias processing for reducing jaggy 
phenomena and flicker removing processing are simultaneously conducted in the same filter processing 

30 and the filter processing is conducted only on edge portions judged by edge detection processing to be 
edges. Thereby, it becomes possible to reduce the amount of computation processing and simplify the 
processing. Furthermore, since patterns other than edges are prevented from blurring, video images having 
a substantial resolution can be outputted. 

According to the third aspect of the present invention, anti-alias processing for reducing jaggy 

35 phenomena and flicker removing processing are simultaneously conducted in the same filter processing 
and the filter processing is conducted with filter characteristics set according to edge information derived by 
edge detection processing. Thereby, it becomes possible to reduce the amount of computation processing 
and simplify the processing. Furthermore, since patterns other than edges are prevented from blurring, 
video images having a substantial resolution can be outputted. 

40 

BRIEF DESCRIPTION OF THE DRAWING 

FIG. 1 is a diagram illustrating jaggy phenomena; 

FIG. 2 is a schematic block diagram showing the configuration of a conventional graphic processor 
45 apparatus; 

FIG. 3 is a block diagram showing the configuration of a first embodiment of a graphic processing 
apparatus according to the present invention for implementing a first embodiment of a graphic 
processing method according to the present invention; 

FIG. 4 is a configuration diagram of a filter processor circuit in the first embodiment; 
50 FIG. 5 is a block diagram showing the configuration of a second embodiment of a graphic processing 
apparatus according to the present invention for implementing a second embodiment of a graphic 
processing method according to the present invention; 

FIG. 6 is a diagram illustrating edge detection in the second embodiment; and 

FIG. 7 is a characteristic diagram showing filter characteristics of the vertical direction and horizontal 
55 direction in the second embodiment. 
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DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Embodiments of the present invention will hereafter be described by referring to drawing. 

around a CPU (central processing unit). Numeral 2 denotes a filter processor circuit which conducts »S 

Operation of the first embodiment will now be described 
< ! ,nni'. nlil<e the ( 9raphic si 9 nal generator circuit 10 of the conventional apparatus shown in FIG 2 the araohic 

izzt^?;:^ sp r frequency components are subjected * 

20 conLct?na anS 31 J ' Phen ° mana Can be reduced a " d **er impairment can be removed By hus 
S^«S^15ST^ ^ f ' iCker rem ° Vin9 Pr ° CeSSi " 9 -y in filter proceLn" 

emhSJJV- C ° nfi9ura * ion dia 9 ram of 1he ^ove described filter processor circuit 2 In the present 
embodiment. it ,s assumed that one-dimensional transversal digital filters which are provided separatet fo 

25 circuit h ° r,20ntal direCti ° nS WhiCh C3n be easi, V conflQ— « -das £ fl Z£2£ 

As shown in FIG. 4, the filter processor circuit 2 includes unity line delay elements (LD) 4 coefficient 
multipliers 5. adders 6, and unity sample delay elements (D) 7 All of them ZZ thl nf coefficient 

n.n , 7 embod,ment ' an,, - alia s Processing and flicker removing processing are conducted simulta 
the f.l er processor circuit. Alternatively, a two-dimensional filter may be used 

nnZfl 6 31 8 den0teS a fllter P roces sor circuit, which conducts spatial filter processino 

ZrZ ,ma9eS t ^r 3 ^ bV ^ 9raphiC Signal 9 enerator circuit 1- Numeral 9 denotes an edg ^ detSon 
processor circuit, wh,ch effects edge detection for each pixel of video images qeneTated bv L n^Z 

Operation of the second embodiment will now be described 
im '"Jt S h ame wayas the first embodiment, the graphic signa. generator circuit 1 does not generate video 
Ts Sa^cT Z 9 T' CS t and h Characte( ' s havi "9 »• ^solution of subpixel, but generates videoimages such 

devS'unTk^ Z IZST' ^ * **** M ^ resolution of * £S 

in FIG 2 The nrZ 7 T 9enera, ° r 10 ° f the conven «°™' Sophie processor apparatus shown 

m FIG 2. The graphic signal generator circuit 1 of the present embodiment differs from the araohic sioZ 
generator crcu.t 10 of the conventional apparatus only in reso.ution of gener^v^,Sl^£^K 
detection processor circuit 9 conducts threshold processing on the absolute value of UplacL i e tte 
second differentia, every pixel and outputs edge informationrepresenting the ma^ul o Z edg to hi 
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filter processor circuit 8. 

In the filter processor circuit 8, filter characteristics are set according to edge information of each pixel 
derived from the edge detection processor circuit 9 and vertical spatial frequency components and 
horizontal spatial frequency components are limited by a low-pass filter. Therefore, jaggy phenomena can 

5 be reduced and flicker impairment can be removed. By thus conducting anti-alias processing and flicker 
removing processing simultaneously in the same processing, processing of the system can be simplified. 
Since low-pass filter processing is not conducted on the entire image, patterns other than edges can be 
prevented from blurring and video images having a substantial resolution can be outputted. 

By referring to FIG. 6, operation of the edge detection processor circuit 9 will now be described. In the 

io present embodiment, Laplacian which is the second differential is used for edge detection. Assuming a 
pixel value at a point (i, j) is f(i, j), digital Laplacian V 2 can be defined by the following formula. 

V 2 f{i, j) = f(i + 1 . j) + f(i-1 , j) +f(i. i + 1 ) + f(i, H Mf(i, j) (1 ) 

75 It is now assumed that three threshold values TH1, TH2 and TH3 are used as the threshold for edge 

detection and relations 0 ^ TH1 £ TH2 ^ TH3 hold true. It is also assumed that edge information obtained 
by threshold processing for the absolute value of Laplacian is k (k = 0, 1, 2, 3). Further supposing that 
there are no edges when k = 0, and the magnitude of an edge is small when k = 1, medium when k = 2, 
and great when k = 3, relations among absolute values of Laplacian, threshold values, and values of k are 

20 given by the following formula. 

k = 0 when 0 ^ |V 2 f (i, j)| < TH1 
k = 1 when TH1 ^ |V 2 f(i, j)| < TH2 
k = 2 when TH2 ^ |V 2 f(i, j)| < TH3 
25 k = 3 when TH3 ^ |V 2 f(i, j)| (2) 

By referring to FIG. 7, filter characteristics of the vertical direction and the horizontal direction of the 
filter processor circuit 8 set according to edge information outputted by the edge detection processor circuit 
9 will now be described. 

30 Assuming now that the sampling frequency in the vertical direction is equal to that in the horizontal 
direction, and the sampling frequency and the Nyquist frequency of the vertical direction and the horizontal 
direction are fs (Hz) and fn (Hz), respectively, the relation of formula (3) typically holds true between the 
sampling frequency and the Nyquist frequency. 

35 fn = 1/2xfs (3) 

FIG. 7 is a characteristic diagram of filter characteristics of the vertical direction and the horizontal 
direction with edge information k = 0, 1 , 2 and 3. The abscissa represents the frequency, and the ordinate 
represents the gain. As the edge information k becomes greater, i.e., the magnitude of the edge becomes 

40 greater, the vertical spatial frequency components and the horizontal spatial frequency componnets are 
limited in bandwidth. If the filter characteristics of the filter processor circuit 8 are thus set beforehand 
according to edge information, filter processing according to edge information can be implemented even if 
conventionally used transversal filters are employed. 

The filter processor circuit 8 differs from the filter processor circuit 2 shown in FIG. 4 only in that 

45 coefficients kv1, kv2, .... kvi and kh1, kh2, .... khj of the coefficient multipliers 5 are switched over by edge 
information of each pixel in the filter processor circuit 8 so as to implement filter characteristics shown in 
FIG. 7 whereas coefficients of the coefficient multipliers are not switched over for each pixel in the filter 
processor circuit 2. 

While the number of threshold values is three in the second embodiment, it is also possible to make the 
50 number of threshold values equal to three and set N + 1 filter characteristics. 

Especially in the case where N = 1, implementing filter characteristics of k = 0 and k = 1 or k = 0 
and k = 2 or k = 0 and k = 3 concretely corresponds to conducting filter processing on the edge portion 
alone. 

Furthermore in the second embodiment, the filter characteristic of FIG. 7 in the case where k = 0 
55 indicates all-pass filter characteristic. Instead of filter processing of this filter characteristic, however, through 
processing involving no filter processing may be conducted. 

As compared with the method of conducting filter processing on the edge portion atone, the method of 
conducting filter processing with filter characteristics set according to edge information becomes more 

5 
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complicated in processing. Since multi-step setting of filter characteristics is possible, however, optimization 
of the overall picture quality concerning the anti-alias effect, flicker removal effect, and resolution is 
facilitated. 

In the second embodiment, the anti-alias processing and flicker removal processing are conducted in 
the same filter processing as heretofore described. Thereby, processing of subpixel unit is eliminated, and it 
becomes possible to reduce the amount of computation processing and simplify the processing Further- 
more, since low-pass filter processing is not conducted on the entire video image, patterns other than 
edges are prevented from blurring and video images having a substantial resolution can be outputted 

In the second embodiment, edge information is calculated every pixel. Alternatively, edge information 
may be calculated every block of several pixels. Furthermore, in the second embodiment, Laplacian of the 
second differential is used for edge detection. Instead of this, however, a different detection method such as 
the first differential, gradient calculation, the Prewitt operator, or the Sobel operator may be used 

While in the second embodiment the filter characteristics of the filter processor circuit 8 of FIG 7 in the 
vertical direction is made identical to those in the horizontal direction, separate filter characteristics may be 
set. Furthermore, while in the second embodiment filter processing in the horizontal direction is conducted 
after filter processing in the vertical direction as the filter processor circuit 8, filter processing in the vertical 
direction may be conducted after filter processing in the horizontal direction. While in the second 
embodiment one-dimensional filters provided separately for the vertical and horizontal directions are used a 
two-dimensional filter may be used. 

According to the first aspect of the present invention, anti-alias processing for reducing jagqy 
phenomena and flicker removing processing are simultaneously conducted in the same filter processing in 
the graphic processing method and graphic processor apparatus. This results in an effect that it becomes 
possible to reduce the amount of computation processing and simplify the processing 

According to the second aspect of the present invention, anti-alias processing for reducing jagqy 
phenomena and flicker removing processing are simultaneously conducted in the same filter processing 
and the filter processing is conducted only on edge portions judged by edge detection processing to be 
edges. This results in an effect that it becomes possible to reduce the amount of computation processing 
and simplify the processing, prevent patterns other than edges from blurring, and output video images 
having a substantial resolution. ^ 
According to the third aspect of the present invention, anti-alias processing for reducing jagqy 
phenomena and flicker removing processing are simultaneously conducted in the same filter processing 
and the filter processing is conducted with filter characteristics set according to edge information derived by 
edge detection processing. This results in an effect that it becomes possible to reduce the amount of 
computation processing and simplify the processing, prevent patterns other than edges from blurring 
output video images having a substantial resolution, and facilitate optimization of the overall picture quality 

Claims 

1. A graphic processing method characterized by comprising the steps of: 

conducting anti-alias processing for reducing jaggy phenomena; and 

conducting flicker removing processing for removing flicker, said flicker removing processing being 
conducted simultaneously together with said anti-alias processing in the form of filter processing. 

2. A graphic processing method according to Claim 1, characterized in that said filter processing is 
conducted only on edge portions judged by edge detection processing to be edges. 

3. A graphic processing method according to Claim 1 or 2, characterized in that said filter processing is 
conducted with filter characteristics set according to edge information derived by edge detection 
processing. a 

4. A graphic processing apparatus characterized by comprising: 

a graphic signal generator circuit (1) for generating video images such as graphics and characters; 

ano 

a filter prcessor circuit (2) for conducting filter processing on video images outputted from said 
graphic signal generator circuit (1), said filter processor circuit being capable of conducting both anti- 
alias processing for reducing jaggy phenomena and flicker removing processing for reducing flicker 

simultaneously. 
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5. A graphic processing apparatus according to Claim 4, characterized in that said filter processor circuit 
(2) conducts filter processing only on edge portions judged by an edge detection processor circuit (9) 
to be edges. 

5 6. A graphic processing apparatus according to Claim 4 or 5, characterized in that said filter processor 
circuit (2) sets filter characteristics according to edge information derived by an edge detection 
processor circuit (9). 

10 



15 



20 



25 



30 



35 



40 



45 



50 



55 

7 

BNSDOCID: <EP 0686941 A2_l_> 



EP 0 686 941 A2 



O UJ 



1 



cr>o 
u_a:a.o 




— < 

18: 



h- 
< 

o 
q. 



CM 

■ 

e> 
u. 



o 

a. en 
Scnh- 
<UJ5 



(no 



o 



cno-O 



l_C9<OI— 



o 



oj>q:9= 



O 



o UJ 



rO 



UJ 



ro 



1 



a: 
o 
cn 

CO I 



Ulzr 
Li- CL O 



<o z °- 
ocnoo 



BNSDOCID: <EP 0696941A2_I_ 



EP 0 686 941 A2 



FIG . 5 



GRAPHIC 
SIGNAL 
GENERATOR 
CIRCUIT 



r 



EDGE 

DETECTION 
PROCESSOR 
CIRCUIT 



FILTER 

PROCESSOR 

CIRCUIT 

J 

8 



3 

.^OUTPUT 



END 



FIG . 6 



o o o 

f(H,j-l) f(i,j-1) f(i+l,j-l) 

O PIXEL 

O • O 

f(H,j) f(L,j) f(L+1,j) • SUBJECT PIXEL 

O O O 

f(L-1,j+1) f(L,j+1) f(W,j+1) 



Fl G . 7 



GAIN 
I A 



k = 3 k=2 k-1 k=0 




fn FREQUENCY (Hz) 



BNSDOCID: <EP 0686941 A2J_> 



10 



(19) 



(12) 



(88) Date of publication A3: 

24.04.1996 Bulletin 1996/17 

(43) Date of publication A2: 

13.12.1995 Bulletin 1995/50 

(21) Application number: 95303838.7 

(22) Date of filing: 06.06.1995 



Europaisches Patentamt 
European Patent Office 

Office europeen des brevets (1 1 ) EP 0 686 941 A3 

EUROPEAN PATENT APPLICATION 

(51) IntCI. 6 : G06T5/20 



(84) Designated Contracting States: 


(72) Inventor: Morimoto, Akihiro 


DE FR GB IT 


Yokohama-shi (JP) 


(30) Priority: 07.06.1994 JP 125329/94 


(74) Representative: Votier, Sidney David 


CARPMAELS & RANSFORD 


(71) Applicant: MATSUSHITA ELECTRIC INDUSTRIAL 


43, Bloomsbury Square 


CO., LTD. 


London WC1A2RA (GB) 


Kadoma-shi Osaka (JP) 





(54) Method and apparatus for graphic processing 



(57) In order to reduce the amount of computation 
processing and simplify processing, a graphic processor 
apparatus includes a graphic signal generator circuit (1) 
for generating video images such as graphics and char- 
acters, and a filter processor circuit (2) for conducting fil- 



ter processing on video images outputted from said 
graphic signal generator circuit (1). Anti-alias processing 
for reducing jaggy phenomena and flicker removing 
processing are simultaneously conducted in the filter 
processor circuit. 
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